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Abstract 

This  paper  studies  the  design  and  the  performance  of  receivers  using  optical  matched 
filters  and  direct  detection,  when  the  basic  pidse  shape  consists  a  rectangular  pulse  of 
monochromatic  light.  The  modulation  format  can  be  ASK,  FSK  or  DPSK.  Such  receivers 
are  useful  when  amplifier  noise  is  the  main  source  of  imcertainty  as  they  optimally  reject 
additive  white  Gaussian  noise.  The  performances  of  ASK  and  FSK  receivers  are  reported, 
taking  into  account  shot  noise  and  the  effects  of  post  detection  filtering. 
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1  Introduction 

In  traditional  receivers  for  optical  fiber  communication  the  shot  noise  and  the  electronic 
thermal  noise  are  the  main  sources  of  uncertainty.  The  advent  of  optical  amplifiers,  wliich 
are  expected  to  dramatically  affect  optical  communication  systems,  profotmdly  changes  the 
sit  nation.  An  optical  amplifier  of  power  gain  G  can  be  modelled  as  an  ideal  noiseless  linear 
optical  field  amplifier  together  with  a  source  of  additive  white  Gaussian  noise  with  two- 
sided  spectral  density  (G  —  l)N,phv {2  per  mode  over  the  bandwidth  of  interest  [14].  In 
that  formula  N^p  is  a  coefficient  greater  than  1  (typically  about  2)  arising  from  imperfections 
in  the  amplifier,  such  as  partial  population  inversion  and  losses,  h  is  Planck’s  constant  and 
u  is  the  optical  frequency.  That  additive  noise  often  dominates  the  other  sources  of  noise, 
both  in  direct  reception  receivers  and  in  coherent  systems  where  the  received  signal  is  mixed 
with  that  of  a  local  oscillator.  In  the  following  discussion  we  assume  that  only  the  additive 
noise  is  present  and  recall  some  well  known  results  of  commmiication  theory.  They  can  be 
found  in  standard  textbooks,  e.g.  [13],  [12],  [5], [6]. 

In  the  case  of  homodyne  coherent  reception  (zero  intermediate  frequency)  with  known 
signal  phase  (synchronous  detection)  the  effect  of  the  additive  noise  can  be  optimally  com¬ 
batted  by  using  an  electronic  filter  matched  to  the  envelope  of  the  optical  signals  (a  filter 
is  matched  to  a  signal  if  its  proportional  to  the  impulse  response  of  the  time  reversed  of 
the  signal).  The  situation  is  similar  in  the  case  of  heterodyne  coherent  reception  (non  zero 
intermediate  frequency),  with  the  proviso  that  a  front  end  filter  must  be  used  to  eliminate 
the  additive  noise  in  the  image  band.  This  filter  must  have  a  passband  wide  enough  to  pass 
the  desired  signal,  and  it  must  cutoff  signals  in  the  image  band,  two  intermediate  frequencies 
away.  A  3dB  penalty  is  incurred  with  heterodyne  detection  if  the  front  end  filter  is  absent. 
The  need  for  that  filter  can  be  avoided  by  using  a  quadrature  receiver  and  rejecting  the 
image  band  at  the  intermediate  frequency. 
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If  the  phase  is  random  but  constant  during  one  symbol,  then  envelope  (for  heterodyne) 
or  quadrature  receivers  (for  homodyne  or  heterodyne)  shoidd  be  used. 

For  Amplitude  Shift  Keing  (ASK,  or  ON/OFF)  modulation  ,  coherent  synchronous 
receivers  have  a  probability  of  error  given  by  Q{y/E/No),  where  E  is  the  average  energy  of 
the  signal  at  the  receiver  (half  the  ON  energy),  and  No/ 2  is  the  two-sided  spectral  density 
of  (he  noise.  The  exact  probability  of  error  for  envelope  detection  cannot  be  expressed 
easily,  but  it  is  about  exp(— (1  -f  FJ/No))  [2],  which  has  the  same  asymptotic  behavior  as  the 
previous  expression.  The  penalty  for  using  envelope  detection  is  slight.  For  a  probability 
of  error  of  10®,  EJNq  must  be  about  36  for  synchronous  detection,  and  38.3  for  envelope 
detection. 

Note  that  in  the  context  of  optical  amplifiers  the  ratio  E/Nq  can  be  interpreted  as  the 
number  of  signal  photons  at  the  input  of  an  ideal  high  gain  amplifier  that  is  the  only  source 
of  noise  in  the  system.  The  reader  will  recognize  that  these  “nmnber  of  photons”  are  similar 
to  those  usually  quoted  for  heterodyne  detection  in  absence  of  an  optical  amplifier.  This  is 
not  surprising  since  the  noises  in  both  an  ideal  amplifier  and  an  ideal  heterodyne  receiver 
are  equivalent  when  referred  to  the  input. 

The  probability  of  error  for  orthogonal  bineiry  Frequency  Shift  Keying  (FSK)  with  syn¬ 
chronous  detection  is  given  by  Q{y/E  jNo)  {E  is  energy  of  each  signal,  thus  also  the  average 
energy)  and  for  envelope  detection  it  is  .5exp(-jS/2No).  These  schemes  requires  EfNo  to 
be  respectively  36  and  40  for  a  probability  of  error  of  10“®. 

For  binary  Phase  Shift  Keying  (PSK)  the  probability  of  error  is  Q{y/2E /No),  i.e.  E/Nq 
equal  to  18  for  a  probability  of  error  of  10~®,  twice  as  good  as  FSK.  Of  course  synchronous 
detection  is  mandatory. 

For  binary  Differential  Phase  Shift  Keying  (DPSK)  (which  only  makes  sense  when  syn¬ 
chronous  detection  is  not  possible),  the  probability  of  error  given  by  .5  exp(— F/Nq),  ignor- 
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ing  error  propagation.  EfNo  needs  to  be  only  20  for  a  probability  of  error  of  10~®,  which 
is  only  slightly  more  than  for  PSK. 

Instead  of  using  coherent  receivers  one  can  also  employ  bandpass  matched  filters  followed 
by  either  synchronous  or  envelope  detection.  Their  performances  are  identical  to  those  of 
corresponding  coherent  receivers,  synchronous  or  envelope.  Our  goal  in  this  paper  is  to 
study  the  performance  of  direct  detection  receivers  using  optical  bandpass  match  filters. 
They  have  some  fundamental  limitations. 

Synchronous  matched  filter  receivers  must  sample  the  output  the  filter  with  a  timing 
precision  measured  in  fraction  of  the  period  of  the  carrier.  This  is  not  possible  at  optical 
frequencies  because  detectors  respond  only  to  the  envelope  of  the  signal.  Thus  we  can  only 
hope  to  do  as  well  as  envelope  detectors.  Another  problem  with  optical  detection  is  that  few 
photons  will  be  collected  during  the  ideal  infinitesimal  sampling  interval  called  for  by  the 
classical  theory.  To  prevent  the  shot  noise  from  becoming  dominant  it  is  always  necessary 
to  integrate  the  output  of  the  matched  filter  for  some  time,  thus  degrading  its  performance. 

The  main  contribution  of  this  paper  is  to  design  optical  filters  that  are  almost  perfectly 
matched  to  rectangular  pulses  of  monochromatic  light,  and  which  could  be  used  in  ASK, 
FSK  and  DPSK  systems  when  chirping  and  phase  noise  are  not  significant.  We  also  report 
on  the  penalty  that  is  caused  by  the  shot  noise  and  by  integrating  the  output  of  the  matched 
filter.  Before  attacking  those  topics  we  make  a  few  more  comparisons  between  coherent  and 
direct  detection  systems. 

Many  optical  sources  have  significant  linewidth  and  the  signal  phase  changes  during 
the  transmission  of  one  symbol.  Optical  filters  will  be  affected  by  phase  noise  exactly 
like  coherent  receivers  with  envelope  detection.  The  absence  of  a  local  oscillator  typically 
reduces  the  effective  intensity  of  the  phase  noise  by  50%  for  optical  filters,  compared  to 
coherent  receivers.  To  the  contrary,  frequency  stabilization  is  probably  more  critical  for 
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optical  filters,  because  they  cannot  readily  track  frequency  fluctuations  in  the  transmitter. 
The  previous  discussion  has  implicitly  assmned  that  the  signal  was  polarized  and  that  the 
other  polarization  was  filtered  out.  Allowing  both  polarizations  decreases  the  performances 
somewhat,  but  not  nearly  as  much  as  a  polarization  mismatch  degrades  coherent  receivers. 

2  Optical  matched  filters 

Suppose  we  have  a  rectangular  pulse  5(t)  of  monochromatic  light  at  frequency  v,  with  length 
T  and  energy  E:  s(t)  =  ^J2E /T  cos{2Tcvt),  t  £  [0,7],  as  in  figure  2.a.  For  mathematical 
convenience  we  will  first  assmne  that  i/  =  2*’/T  for  some  moderately  large  integer  k.  Assume 
one  divides  the  signal  equally  in  two  branches,  which  are  recombined  after  imdergoing  a 
differential  delay  of  exactly  7/2.  The  envelope  of  the  recombined  field  wordd  then  be  as  in 
figure  2.b.  It  has  length  1.57,  with  2  up  steps  and  2  down  steps. 

The  device  that  would  realize  what  we  have  just  described  is  simply  a  Mach-Zehnder 
filter  with  differential  delay  7/2.  In  figure  1  we  use  the  ouput  diagonally  opposed  to  the 
input  so  as  to  produce  the  sum  of  the  input  signal  and  its  delayed  version.  The  other  output 
branch  produces  the  difference. 

If  the  output  signal  is  split  again  and  recombined  after  a  differential  delay  of  7 /4,  the 
envelope  will  be  as  in  figure  2.c.  Note  that  there  are  4  up  steps  and  4  down  steps  and  the 
length  is  now  1.757.  If  one  use  k  stages,  using  differential  delays  that  decrease  by  a  factor 
of  2  every  time,  the  recombined  field  will  have  2^  up  steps,  as  many  down  steps,  and  a 
length  (2  —  2~^)T.  Note  that  the  amplitude  at  the  center  is  constant  in  all  these  figures. 
One  sees  that  the  output  converges  geometrically  to  the  triangle  of  base  27  that  wotdd  be 
produced  by  a  true  matched  filter  (figure  2.d).  If  z/  7^  2*^7  then  the  delays  must  be  adjusted 
around  their  nominal  value  so  that  the  signals  add  in  phase  at  the  Mach-Zehnder  outputs. 

The  process  can  also  be  visualized  in  the  frequency  domain.  The  k  stage  filter  has  a 
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frequency  response  given  by  JJ^^i  cos(2~^TrfT)  =  sm(7rfT)/2^sm(2~^irfT).  This  is  dis¬ 
played  in  figure  3  for  fc  =  3,  together  with  the  response  sin(T/T)/7r/T  of  a  matched  filter 
(of  course  those  responses  are  actually  centered  at  ±i/).  Note  that  the  approximate  filter 
is  close  to  ideal  for  frequencies  smaller  than  1/T  (where  the  signal  energy  lies),  but  its 
response  magnitude  is  periodic  with  period  2^/r,  thus  letting  in  the  noise  in  the  undesired 
periods.  In  practice  our  filter  would  be  cascaded  with  another  optical  bandpass  filter  of 
bandwidth  2^/T,  thus  eliminating  the  undesired  noise  and  smoothing  the  output  signal. 
The  other  filter  could  be  a  grating,  or  a  thin  fihn  interference  filter  possibly  grown  directly 
on  the  facet  of  a  fiber,  as  is  commonly  done  in  fiber  Fabry-Perot  interferometers  [7],  [8]. 
For  example  if  T  is  1  ns  and  k  is  7,  the  bandwith  of  the  other  filter  would  be  about  1  nm 
if  1/  is  in  the  1.5  pm  band. 

The  filter  just  described  has  been  proposed  before  as  a  chaimel  selection  filter  for  op¬ 
tical  frequency  division  multiaccess  systems  [10].  Its  optimed  noise  rejection  property  has 
apparently  not  been  pointed  out.  Integrated  versions  of  the  filter  have  been  realized  [3], 
[9],  [11]  using  silica  on  silicon  teclmologies.  One  implementation  had  fc  =  7,  T  =  .2  ns  and 
an  insertion  loss  of  about  6  dB.  Such  a  loss  affects  the  additive  noise  as  well  as  the  signal 
and  thus  it  is  not  very  significant  when  the  additive  noise  is  the  main  source  of  uncertainty. 
The  next  section  will  provide  more  quantitative  statements. 

The  previous  filter  can  be  used  alone  with  ASK  modulation  together  with  a  single 
photodiode.  After  filtering,  the  output  current  must  be  compeired  to  a  threshold  to  arrive 
at  a  decision  (see  figure  4.a). 

In  the  case  of  binary  FSK  modulation,  2  matched  filters  would  be  needed,  one  for 
each  tone,  together  with  a  balanced  receiver  consisting  of  two  photodiodes  as  in  figure 
4.b.  Decisions  can  be  based  on  the  sign  of  the  current,  no  energy  dependent  threshold  is 


necessary. 
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In  the  case  of  DPSK  we  can  view  the  signal  as  consisting  of  two  parts:  a  reference  part 
(actually  the  previous  bit)  followed  by  a  signal  part,  which  is  either  the  reference  signal 
delayed  by  T  or  its  negative.  The  filter  matched  to  one  signal  should  thus  have  response 
s{~t)+s[—t+T),  while  the  other  filter  should  have  response  s{—t)  —  s{~t+T).  Of  course  the 
implementation  of  those  operations  is  very  simple:  the  matched  filter  5(— t)  for  am  isolated 
pulse  should  be  followed  by  a  Mach-Zelmder  filter  with  differential  delay  T  (figure  4.c).  One 
output  branch  has  impulse  response  .5(^(t)  —  S{t  —  T))  while  the  other  branch  has  response 
.5(^(t)  +  S{t  -  T)),  so  that  the  cascade  has  the  desired  response.  The  resulting  structure 
is  simply  a  matched  filter  for  pulses  of  length  2T,  with  two  outputs  being  used!  Again  a 
balanced  photoreceiver  is  called  for. 

In  the  next  section  we  focus  on  some  fimdamental  issues  for  ASK  and  FSK:  the  effect 
of  post  filtering  and  of  shot  noise.  More  complete  studies  will  be  reported  elsewhere. 

3  Shot  noise  and  post  filtering 

As  already  indicated  shot  noise  imposes  fundamental  limitations  on  optical  systems.  In 
particular  the  output  of  the  matched  filter  cannot  be  sampled  using  a  photodetector,  but 
to  the  contrary  the  output  from  the  detector  must  be  low  pass  filtered.  This  causes  some 
deviation  from  the  classical  theory.  We  have  performed  an  analysis,  too  long  to  be  reported 
here,  of  the  degradation.  We  assume  that  the  low  pass  filter  is  an  ideal  integrate  and  dump 
filter,  with  an  integration  time  from  -aT  to  aT.  Thus  a  small  a  corresponds  to  weak 
filtering,  a  cannot  be  larger  than  .5  without  causing  too  much  intersymbol  interference. 

For  binary  FSK  with  wide  frequency  deviation  we  plot  in  figure  5  the  necessary  E/Nq 
for  Pg  =  10“®  as  a  function  of  a  for  various  values  of  Nq.  Nq  is  expressed  in  photons.  For 
example  if  the  only  source  of  noise  is  an  ideal  optical  amplifier  with  G  —  101  placed  just 
before  the  detector,  then  No  =  100.  If  there  is  a  6dB  loss  between  the  amplifier  and  the 
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detector  then  Nq  decreases  to  25. 

For  low  a  the  increase  in  required  E /Nq  is  due  to  the  shot  noise.  At  larger  a  the  penalty 
conies  from  the  fact  that  the  collected  signal  energy  increases  more  slowly  than  the  average 
noise  energy.  This  graph  does  not  take  the  thermal  noise  into  account.  We  expect  it  to 
cause  the  same  general  effect  as  the  shot  noise,  but  with  a  different  magnitude.  Similarly 
the  effect  of  intersymbol  interference  wiU  magnify  the  penalty  for  using  a  large  a. 

We  expect  small  deviation  FSK  to  behave  in  the  seime  way  for  small  a,  but  its  perfor¬ 
mance  for  larger  a  might  be  somewhat  different.  Similarly  DPSK  should  follow  the  FSK 
curve,  except  that  it  reqtures  only  half  as  many  photons. 

Results  appear  in  figure  6  for  ASK  modulation,  threshold,  and  to  optimize  on  the 
threshold.  The  required  signal 

4  Conclusion 

This  paper  has  outlined  the  structure  of  optical  filters  matched  to  ptdses  of  monochromatic 
waves.  They  could  be  used  with  ASK,  FSK  and  DPSK  modulations  in  systems  where  chirp 
and  phase  noise  are  negligible,  and  where  the  main  source  of  uncertainty  is  sponteuieous 
amplifier  noise.  For  wide  deviation  FSK  and  ASK  we  have  shown  the  effects  of  the  unavoid¬ 
able  penalty  arising  in  direct  detection  optical  systems  from  shot  noise  and  from  the  need 
to  integrate  the  output  of  the  photodetector.  These  effects  are  small. 
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Figure  1:  Structure  of  the  matched  filter 


Frequency  response  with  3  stages 


Figure  3:  Frequency  response 


